Display device, electronic device and image processing apparatus including the display device, and method of displaying information

ABSTRACT

On a touch-panel display of an image forming apparatus, a function selecting area and a preview area are displayed next to each other. On the function selecting area, a function setting menu is displayed in one display mode among an icon mode in which only a group of icons are displayed, a regular mode in which a group of icons and a group of texts are displayed, and an express mode in which a group of icons, a group of texts and a group of function setting buttons are displayed. In the icon mode, detailed preview information is displayed on a large preview area, and in the express mode, detailed function selecting information is displayed on a large function selecting area.

CROSS-REFERENCE TO RELATED APPLICATION

This nonprovisional application claims priority under 35 U.S.C. § 119(a)on Patent Application No. 2010-025495 filed in Japan on Feb. 8, 2010,the entire contents of which are hereby incorporated by reference.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates to a display device that allows, even ifan operational mode of an electronic device or an image processingapparatus is changed and screen images are switched accordingly, theuser to appropriately grasp the pieces of information displayed in eachoperational mode. Particularly, the present invention relates to adisplay device capable of presenting, when the screen image is dividedinto a plurality of areas for displaying function setting informationand preview information (though not limited to these pieces ofinformation), the function setting information and the previewinformation in an appropriate manner by changing the size of areas. Thepresent invention also relates to an electronic device and an imageprocessing apparatus provided with such a display device.

Description of the Background Art

As one type of image processing apparatuses as electronic equipment,image forming apparatuses forming images on recording paper (typically,copy machines) are introduced to many places of business (companies andoffices). In such a place of business, it has become increasingly commonto connect an image forming apparatus having a printer function or acopy function to a network, to allow use (sharing) by a plurality ofusers. A multifunction peripheral (MFP) as one type of such imageforming apparatuses has a plurality of basic operational modes such as acopy mode, a facsimile mode (hereinafter “facsimile” may also be denotedas FAX or fax), a network-supported printer mode and a scanner mode. Insuch an image forming apparatus, each user selects an operational modeand selects and makes settings of a function of duplex (two-sided)printing or collective printing (such as 2-in-1 by which two pages of anoriginal document are printed on one sheet, or 4-in-1 by which fourpages of an original document are printed on one sheet), whereby imagesare formed on sheets of paper in a desired manner. Appropriatecombinations of these functions come to be more frequently used.

When a user uses such an image forming apparatus, for example, the userinputs image data in the scanner mode, performs image processing (suchas collection) by inputting various instructions through an operationpanel, and prints the results on a sheet of recording paper. In such asituation, the operation panel, serving as an operation and displayunit, functions as an interface between the image forming apparatus andthe user. Generally, on the operation panel, a screen image for settingfunctions in each operational mode is displayed, so that the user caneasily set various functions. Further, while a job is being executed,job progress status may be displayed, to allow the user to easily graspthe progress status of the job. In the printer mode executed uponreception of data from an external device, the job progress status maybe displayed in accordance with the data received from the externaldevice as a source.

Recently, a touch-panel display having a touch-panel formed on a liquidcrystal panel (display panel) comes to be increasingly used as such anoperation panel. By way of example, items (software buttons) allowingselection of a mode of the image forming apparatus are displayed on thetouch-panel display, the user viewing the display presses a position ofan item displayed on the touch-panel display (presses a softwarebutton), and the operational mode is set.

Such a touch-panel display having both the display and operationfunctions is advantageous in that it eliminates the necessity ofproviding a display unit and an operation unit separately. Further, itattracts attention recently since a command can be selectedadvantageously in accordance with the user's sense, when it is adaptedsuch that a command can be selected in accordance with a trajectory ofpressing of the touch-panel display by the user's finger. Examples ofsuch command selection using finger trajectory include the following.

When a plurality of pages are displayed on the touch-panel display asprint previews, the following operations may be performed. By a useroperation of lightly tapping twice (hereinafter also referred to asdouble-tapping) a position of a certain page displayed as a preview, acommand to display the page in an enlarged or reduced size can beselected. By a user operation trajectory of expanding a space betweentwo fingers (hereinafter also referred to as pinch-out or pinch-open), acommand to display the page in an enlarged size can be selected, and bya user operation trajectory of reducing a space between the two fingers(hereinafter also referred to as pinch-in or pinch-close), a command todisplay the page in a reduced size can be selected. In the following,these operations are denoted as gesture operations. The gestureoperations are not limited to the above, and may include: tapping, orlightly touching an item displayed on the touch-panel display; dragging,or sliding an item with a finger; flicking, or lightly sweeping an itemto scroll; and pinching with two fingers. It is noted that, strictlyspeaking, the tapping and double-tapping are not determined by the useroperation trajectory on the touch-panel display (determined not by thetrajectory but by detection of a position). The user's request, however,can also be detected by these operations and, therefore, these are alsoincluded in the gesture operations in the present specification.

Further, in the present specification, an operation other than thegesture operations as such will be described as a touch operation. Thetouch operation means an operation of detecting a user's request basedon the position of operation by the user on the touch-panel. Arepresentative example of the touch operation is an operation of theuser pressing a position of an item (pressing a software button)displayed on the touch-panel display.

In an MFP provided with a touch-panel display allowing both touchoperation and gesture operation, it is possible for a user to adjustsettings related to various image processing operations such as marginsize, and make settings for finish, including stamping, stapling andpunching. If such a finish function or functions are set for printing,the user cannot confirm the finished form until he/she obtains theresult of actual printing. Therefore, it is not unusual that a user setsa finish with punched holes and when actually printed, the output is afailed copy having images overlapped with the positions of holes to bepunched. This leads to waste of consumables (toner and recording paper).

In order to solve such a problem, Japanese Patent Laying-Open No.2006-3568 (hereinafter referred to as '568 Reference) discloses an imageforming apparatus that allows a user to confirm finished form beforeactually executing printing, thereby realizing accurate and simplifiedsetting work.

The image forming apparatus includes a finished form informationgenerating unit, an input screen image information generating unit, adisplay unit and a setting unit. The finished form informationgenerating unit generates information of finished form screen imageexpected when image data processing and print finish processing aredone. The input screen image information generating unit generates inputscreen image information for receiving setting input by an operator,based on the information of expected finished form screen imagegenerated by the finished form information generating unit. The displayunit displays the expected finished form based on the information ofexpected finished form screen image, and an input image screen based onthe input screen image information generated by the input screen imageinformation generating unit. The setting unit receives a setting input,including a setting input by the operator through the input screen imagedisplayed on the display unit.

In the image forming apparatus, the information of expected finishedform screen image after image data processing and print finishprocessing are done is generated. Based on the generated information ofexpected finished form screen image, the input screen image informationis generated, for receiving a setting input by the operator. Theexpected finished state based on the information of expected finishedform screen image and the input screen image based on the input screenimage information are displayed, and the setting input including asetting input by the operator through the displayed input screen imageis received. Since the information of expected screen image and thesetting screen image information allowing input by the operator aregenerated in accordance with the input image data, and the expectedprinting state and the setting input screen image are displayed asdescribed above, it is possible to display the expected finished formscreen image before setting various functions, to display items forsetting necessary functions from complicated menu items, and thereby topresent an accurate and simplified setting menu that is easy to graspintuitively. Thus, an image forming apparatus realizing highly efficientand convenient setting work can be provided.

Further, Japanese Patent Laying-Open No. 2007-188054 (hereinafterreferred to as '054 Reference) discloses an image forming apparatus inwhich a preview image of a finished form is displayed before actuallyprinting a copy, allowing the user to change print setting as necessary.

The image forming apparatus includes: an image data input unit; an imagestorage unit; a tentative finished form information generating unit; aninput screen image information generating unit; a display unit; asetting unit; and a copying unit. The image data input unit inputs imagedata. The image storage unit stores sample image data in advance. Thetentative finished form information generating unit generates tentativefinished form information expected when setting is done based on variouspieces of setting information on the sample image data. The input screenimage information generating unit generates input screen imageinformation including setting process items for receiving varioussetting inputs related to the tentative finished form information. Thedisplay unit displays the input screen image based on the tentativefinished form information and the input screen image information. Thesetting unit outputs the contents of setting inputs received through theinput screen image to the tentative finished form information generatingunit, to realize the setting. The copying unit executes the process forcopying the image data input through the image data input unit, based onthe tentative finished form information.

In the image forming apparatus, various items are set on the inputscreen image provided in accordance with the input screen imageinformation and the tentative finished form information based on thesample image data. The tentative finished form information reflectingthe setting is displayed on the display unit. Therefore, pre-scanning ofa document becomes unnecessary, and hence the process of setting variousitems can be done at higher speed.

Various electronic devices as represented by the image forming apparatusand an image processing apparatus include a touch-panel display as adisplay device. As disclosed in the references described above, variouspieces of information are displayed on the touch-panel display. Theimage forming apparatus as one of such electronic devices has aplurality of functional modes or process functions (operational modes).When a user selects an operational mode, an initial screen imagecorresponding to the selected operational mode is displayed on thetouch-panel display. In the reference described above, on the screenimage of a copy mode as one operational mode, a preview after imageprocessing and before execution of printing is displayed. The user setsediting function or functions while viewing the preview.

However, if a large area is necessary for displaying preview information(for example, if previews of a plurality of pages are to be displayed todetermine layout of a plurality of documents), it is impossible to fullypresent the preview information to the user with a small preview screenimage. On the other hand, if the preview screen image is large whileonly a small area is necessary to display the preview information (forexample, when a preview of one page is displayed to carry out imageprocessing of a single document), an area for presenting editingfunctions to the user becomes too small, and it is impossible to fullypresent the function selection information to the user.

In regard of such a problem, what is disclosed in '568 Reference issimply an image forming apparatus in which the information of expectedfinished form is presented as the preview information on a presentingarea of a fixed size. What is disclosed in '054 Reference is simply animage forming apparatus provided with a touch panel having functionselection buttons on opposite sides of a preview displayed on an area ofa fixed size. Therefore, even when the amount of information requiredfor appropriately giving the preview information to the user changes, orwhen the amount of information required for appropriately giving thefunction setting information to the user changes, the size of previewarea and the size of function selecting area are fixed and, hence, theproblem that necessary information cannot fully be given to the userremains unsolved.

Further, none of the references described above discloses changing themanner of displaying the preview or the manner of displaying thefunction selection menu in accordance with an operation by the user, inorder to facilitate the next operation by the user, and changing themanner of displaying the preview or the manner of displaying thefunction selection menu in order to facilitate confirmation of theresult of operation by the user.

SUMMARY OF THE INVENTION

In view of the problem described above, it is desirable, when a resultof processing based on functions set in an electronic device and animage processing apparatus (image forming apparatus) is displayed as apreview before actual processing, to provide a technique of accuratelypresenting the preview information and the function setting informationrequired by the user.

According to an aspect, the present invention provides a display deviceprovided on an apparatus as an object of control. The display deviceincludes: a display unit displaying, on an approximately rectangularplanar display area, information to be notified to a user; a displaycontrol unit dividing the planar display area into a plurality of areasand displaying information with a first display area displaying a firstinformation and a second display area displaying second informationarranged next to each other; and an area changing unit, changing mannerof display of the first information, and thereby changing width alongthe longitudinal direction of the planar display area of the firstdisplay area and width along the longitudinal direction of the planardisplay area of the second display area, to display information. Thefirst information includes setting information for setting a function ofthe apparatus as the object of control. The second information includespreview information displaying, before execution, expected result of aprocess executed by the function set using the first information in theapparatus as the object of control.

In the display device, the planar display area has an approximatelyrectangular shape. Therefore, by adjusting the width of the first andsecond display areas in the longitudinal direction of the planar displayarea, the size of the first and second display areas can be changed in aflexible manner. For instance, if the amount of first information islarge, the width of the first display area can be made wider (and thewidth of the second display area becomes narrower as a result), and thefirst information of large amount can accurately be given to the user.On the other hand, if the amount of second information is large, thewidth of the second display area can be made wider (and the width of thefirst display area becomes narrower as a result), and the secondinformation of large amount can accurately be given to the user. Even ifthe amount of preview information and the amount of setting informationvary, the preview information and the setting information required bythe use can accurately be presented to the user. Assume, for example,that the apparatus as the object of control is an apparatus thatexecutes a process of printing a plurality of documents. Then, thesetting function includes functions intended for a plurality of pagesand functions intended for a single page. When a function intended for aplurality of pages is used, it becomes necessary to show the result ofprocessing of the plurality of pages as a preview and, therefore, theamount of preview information tends to increase. In such a case, themanner of display of the first information is changed to make wider thesecond display area, so that the preview information of large amount canbe displayed accurately.

The setting information may be displayed either in a first manner ofdisplay displaying icons, or in a second manner of display displayingthe icons and function information related to the function.Alternatively, the setting information may be displayed either in afirst manner of display displaying icons, or in a second manner ofdisplay displaying function information related to the function andlarger than the icons. Then, the area changing unit may change thesecond manner of display to the first manner of display, so as to changethe width along the longitudinal direction of the planar display area ofthe first display area and the width along the longitudinal direction ofthe planar display area of the second display area, to displayinformation. Alternatively, the area changing unit may change the secondmanner of display to the first manner of display, so as to make narrowerthe width along the longitudinal direction of the planar display area ofthe first display area and to make wider the width along thelongitudinal direction of the planar display area of the second displayarea, to display information.

In order to set a function of the apparatus as the object of control,icons and/or pieces of function information are prepared. Each piece offunction information is larger in size than each icon. Therefore, whenthe first information is displayed in the first manner of display (iconsonly), the first display area can be made narrower than when it isdisplayed in the second manner of display (which includes at least thefunction information and may or may not include icons). If the amount ofpreview information is large, it is possible to display the firstinformation in the first manner of display to make narrower the firstdisplay area and to make wider the second display area, so that thepreview information of large amount can accurately be displayed.

The display device may further include a touch-panel arranged on thedisplay unit, detecting either a touch operation based on a positionwhere a finger tip of a user touched, or a gesture operation based on atrajectory of positions where the finger tip of the user touched. Then,the area changing unit changes the manner of display either by the touchoperation or the gesture operation.

It is possible to change which manner of display (first manner ofdisplay or second manner of display) is used for displaying the firstinformation, by a touch operation or a gesture operation on thetouch-panel. Particularly, the gesture operation is suitably used by theuser, as the manner of display is changed intuitively in accordance withthe user's sense. Thus, a preferred user interface can be realized.

The area changing unit may change the second manner of display to thefirst manner of display by a gesture operation of making narrower thefunction information displayed in the second manner of display.Alternatively, the area changing unit may change the first manner ofdisplay to the second manner of display by a gesture operation of makingwider an icon displayed in the first manner of display.

By the gesture operation of narrowing the function information, themanner of display can be changed from the second manner of display tothe first manner of display (here, the width of second display areabecomes wider), or by the gesture operation of widening an icon, themanner of display can be changed from the first manner of display to thesecond manner of display (here, the width of the second display areabecomes narrower). Thus, the manner of display can be changed inaccordance with the sense of the user.

The display control unit may display a list of functions settable in theapparatus as the object of control, on the first display area.Alternatively, the display control unit may display a list of functionssettable in the apparatus as the object of control and overlapped on apart of the second display area.

When there is a large number of function items that can be set in theapparatus as the object of control, a list can be displayed. Therefore,it is possible for the user having difficulty in determining anoperation to select a function from the list. Here, by displaying thelist overlapped on a part of the second display area displaying thepreview information, the user notices from a displayed part of thepreview, after selecting and setting a function from the list, that thepreview is displayed in an overlapped manner. It is possible to have thepreview fully displayed if the user selects that part.

According to another aspect, the present invention provides anelectronic device provided with the above-described display device.According to a still another aspect, the present invention provides animage processing apparatus provided with the above-described displaydevice.

In the electronic device and the image processing apparatus, the displaydevice provided therein has an approximately rectangular planar displayarea. By adjusting the width of the first and second display areas inthe longitudinal direction of the planar display area, the size of thefirst and second display areas can be changed in a flexible manner. As aresult, information related to the electronic device and the imageforming apparatus can be presented accurately to the user.

According to a still further aspect, the present invention provides amethod of displaying information on a display unit of a display deviceprovided on an apparatus as an object of control, the display unithaving an approximately rectangular planar display area and displayinginformation to be notified to a user, the method including the steps of:dividing the planar display area into a plurality of areas anddisplaying information with a first display area displaying a firstinformation and a second display area displaying second informationarranged next to each other; changing manner of display of the firstinformation, and thereby changing width along the longitudinal directionof the planar display area of the first display area and width along thelongitudinal direction of the planar display area of the second displayarea, to display information; wherein the first information includessetting information for setting a function of the apparatus as theobject of control; and the second information includes previewinformation displaying, before execution, expected result of a processexecuted by the function set using the first information in theapparatus as the object of control.

Preferably, the setting information is displayed either in a firstmanner of display displaying icons, or in a second manner of displaydisplaying the icons and function information related to the function;and the method of displaying information further includes the step ofchanging the second manner of display to the first manner of display,and thereby changing the width along the longitudinal direction of theplanar display area of the first display area and the width along thelongitudinal direction of the planar display area of the second displayarea, to display information.

More preferably, the setting information is displayed either in a firstmanner of display displaying icons, or in a second manner of displaydisplaying function information related to the function and larger thanthe icons; and the method of displaying information further includes thestep of changing the second manner of display to the first manner ofdisplay, and thereby changing the width along the longitudinal directionof the planar display area of the first display area and the width alongthe longitudinal direction of the planar display area of the seconddisplay area, to display information.

More preferably, the method of displaying information further includesthe step of changing the second manner of display to the first manner ofdisplay, and thereby making narrower the width along the longitudinaldirection of the planar display area of the first display area andmaking wider the width along the longitudinal direction of the planardisplay area of the second display area, to display information.

Preferably, the display device further includes a touch-panel formed onthe display unit, detecting either a touch operation based on a positionwhere a finger tip of a user touched, or a gesture operation based on atrajectory of positions where the finger tip of the user touched; andthe method of displaying information further includes the step ofchanging the manner of display either by the touch operation or thegesture operation.

More preferably, the method of displaying information further includesthe step of changing the second manner of display to the first manner ofdisplay by a gesture operation of making narrower the functioninformation displayed in the second manner of display.

Further preferably, the method of displaying information furtherincludes the step of changing the first manner of display to the secondmanner of display by a gesture operation of making wider an icondisplayed in the first manner of display.

Preferably, the method of displaying information further includes thestep of displaying a list of functions settable in the apparatus as theobject of control, on the first display area.

More preferably, the method of displaying information further includesthe step of displaying a list of functions settable in the apparatus asthe object of control and overlapped on a part of the second displayarea.

By the present invention, when a result of processing based on functionsset in an electronic device and an image processing apparatus (imageforming apparatus) is displayed as a preview before actual processing,the preview information and the function setting information required bythe user can accurately be presented to the user.

The foregoing and other objects, features, aspects and advantages of thepresent invention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view showing an appearance of the image formingapparatus in accordance with an embodiment of the present invention.

FIG. 2 schematically shows an internal configuration of the imageforming apparatus shown in FIG. 1.

FIG. 3 is a functional block diagram showing a hardware configuration ofthe image forming apparatus shown in FIG. 1.

FIG. 4 shows display areas of a touch-panel display of the image formingapparatus shown in FIG. 1.

FIG. 5 is a flowchart representing a control structure of a programexecuted by the image forming apparatus in accordance with theembodiment of the present invention.

FIG. 6 shows a home screen image displayed on the touch-panel display ofthe image forming apparatus in accordance with the embodiment of thepresent invention.

FIG. 7 shows a copy mode initial screen image displayed in the regularmode, displayed on the touch-panel display of the image formingapparatus in accordance with the embodiment of the present invention.

FIG. 8 shows a mail mode initial screen image displayed in the regularmode, displayed on the touch-panel display of the image formingapparatus in accordance with the embodiment of the present invention.

FIG. 9 shows a FAX mode initial screen image displayed in the regularmode, displayed on the touch-panel display of the image formingapparatus in accordance with the embodiment of the present invention.

FIG. 10 shows a document filing mode initial screen image displayed inthe regular mode, displayed on the touch-panel display of the imageforming apparatus in accordance with the embodiment of the presentinvention.

FIG. 11 shows a copy mode initial screen image displayed in the iconmode, displayed on the touch-panel display of the image formingapparatus in accordance with the embodiment of the present invention.

FIG. 12 shows a copy mode initial screen image displayed in the expressmode, displayed on the touch-panel display of the image formingapparatus in accordance with the embodiment of the present invention.

FIG. 13 shows details of the express mode of FIG. 12.

FIG. 14 illustrates transitions among display modes (icon mode, regularmode and express mode).

FIG. 15 shows a manner of setting copy magnification function in theregular mode.

FIG. 16 shows a manner of setting copy magnification function in theicon mode.

FIGS. 17 to 20 show exemplary displays of preview area in the icon mode.

FIG. 21 shows a full list display screen image in the copy mode,displayed on the touch-panel display of the image forming apparatus inaccordance with the embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following description, the same components are denoted by thesame reference characters. Their names and functions are also the same.Therefore, detailed description thereof will not be repeated.

The electronic device in accordance with an embodiment of the presentinvention is an image forming apparatus as one type of image processingapparatuses. The display device in accordance with the present inventionmay be applicable to an image processing apparatus or an electronicdevice other than the image forming apparatus. The electronic device inaccordance with the present embodiment may be any apparatus having aplurality of operational modes and provided with the display devicehaving two or more display modes for suitably changing the size of areasfor displaying information so that when, at least in one of theoperational modes, a function selection menu (information displayed on afunction setting/confirmation area 2000 as will be described later) andpreview information (information displayed on a preview area 3000 aswill be described later) are displayed on the touch-panel display, thefunction selection menu and the preview information can appropriately bepresented to the user.

The image forming apparatus in accordance with the present embodimentincludes a touch-panel display allowing operation by the gestureoperation method and the touch-operation method not using the gestureoperation. The apparatus, however, may include a touch-panel displayallowing touch operation only. Alternatively, the apparatus may includea display panel, capable of display only and not allowing any operation,and buttons for operation.

The image forming apparatus forms an image on a sheet of recording paperby electro-photography. The image forming apparatus includes, asoperational modes, copy mode, FAX mode, document filing mode (a mode inwhich a scanned image is stored in a storage device in the image formingapparatus) and mail mode (a mode in which a scanned image is transmittedattached to an electronic mail). The image forming apparatus may furtherinclude network printer mode. The present invention is not limited tothe above, and it may be any image forming apparatus including at leastone of the four operational modes, that is, copy mode, FAX mode,document filing mode and mail mode, in which the function selection menuand the preview information are displayed on the touch-panel display inat least one of the operational modes. Further, the printing method isnot limited to electro-photography.

[Image Forming Apparatus: Function]

Referring to FIGS. 1 to 3, an image forming apparatus 100 in accordancewith the present embodiment will be described.

Referring to FIGS. 1 to 3, image forming apparatus 100 includes adocument reading unit 102, an image forming unit 104, a paper feed unit106, a paper discharge unit 108 and an operation unit 120. Operationunit 120 includes a touch-panel display 130 and a display operation unit140. Touch-panel display 130 includes a display panel 132 formed of aliquid crystal panel or the like, and a touch-panel 134 arranged ondisplay panel 132, for detecting a position pressed by the user'sfinger. Display operation unit 140 includes a pilot lamp 142, a powerkey 144, an energy-saving key 146, and a home key 148 for returning thedisplay screen image on touch-panel display 130 to a home screen imagefor selection of an operational mode.

As described above, image forming apparatus 100 in accordance with thepresent embodiment is provided with touch-panel display 130 as a mainoperation device, and, in addition, with display operation unit 140including hardware keys and a pilot lamp. The keys (power key 144,energy-saving key 146 and home key 148) of display operation unit 140are hardware buttons, different from the software buttons realized bytouch-panel display 130. It is noted that image forming apparatus 100 isnot limited to one having display operation unit 140 as such, and it maybe provided only with touch-panel display 130. The invention isapplicable to any apparatus in which the display is switched to aninitial screen image of a selected operational mode, when the userselects the operational mode on the home screen image displayed ontouch-panel display 130. The operational modes of image formingapparatus 100 as such will be described.

—Copy Mode—

In the following, an operation in the copy mode will be described. Inthe copy mode, mainly document reading unit (also referred to as ascanner unit) 102 and image forming unit 104 operate.

In image forming apparatus 100, a document placed on a platen is read bydocument reading unit 102 as image data. The read image data is input toCPU (Central Processing Unit) 300 implemented, for example, by amicrocomputer shown in FIG. 3. The image data is subjected to variousimage processing operations here, and the resulting image data is outputto image forming unit 104.

Image forming unit 104 is for printing an image of the documentrepresented by the image data on a recording medium (in most cases, on asheet of recording paper). Image forming unit 104 includes aphotoreceptor drum 222, a charger 224, a laser scanning unit(hereinafter denoted as LSU) 226, a developer 228, a transfer device230, a cleaning device 232, a fixing device 234 and a neutralizer, notshown.

In image forming unit 104, a main feeding path 236 and a reverse feedingpath 238 are provided, and a sheet of recording paper fed from paperfeed unit 106 is fed along main feeding path 236. Paper feed unit 106draws out sheets of recording paper stacked on a paper feed cassette 240or on a manual feed tray 242 one by one, and feeds the sheet of paper tomain feeding path 236 of image forming unit 104.

While the sheet of recording paper is fed along main feeding path 236 ofimage forming unit 104, the sheet passes between photoreceptor drum 222and transfer device 230, and further passes through fixing device 234,whereby printing is done on the sheet of recording paper.

Photoreceptor drum 222 rotates in one direction, and its surface iscleaned by cleaning device 232 and the neutralizer and, thereafter,uniformly charged by charger 224.

LSU 226 modulates the laser beam based on the image data to be printed,and repeatedly scans the surface of photoreceptor drum 222 with themodulated laser beam in a main scanning direction, whereby anelectrostatic latent image is formed on the surface of photoreceptordrum 222.

Developer 228 develops the electrostatic latent image by supplying tonerto the surface of photoreceptor drum 222, and thus, a toner image isformed on the surface of photoreceptor drum 222.

Transfer device 230 transfers the toner image on the surface ofphotoreceptor drum 222 to the sheet of recording paper passing betweentransfer device 230 and the photoreceptor drum 222.

Fixing device 234 includes a heating roller 248 and a pressure roller250. Heating roller 248 is for heating the sheet of recording paper.Pressure roller 250 is for pressing the sheet of recording paper. As thesheet of recording paper is heated by heating roller 248 and pressed bypressure roller 250, the toner image that has been transferred to thesheet of recording paper is fixed on the sheet. A heater is heated byelectric power supplied to fixing device 234 and controlled such thattemperature of heating roller 248 attains to an appropriate temperaturefor fixing. When operational mode is changed to the energy saving mode,power supply to the heater is, for example, stopped or reduced.

At a position of connection between main feeding path 236 and reversefeeding path 238, a separation pawl 244 is arranged. When printing isdone only on one side of the sheet of recording paper, separation pawl244 is so positioned that the sheet of recording paper fed from fixingdevice 234 is guided to paper discharge tray 246 or a paper dischargeunit 108.

When printing is done on both sides of the sheet of recording paper,separation pawl 244 is turned to a prescribed direction, so that thesheet of recording paper is guided to reverse feeding path 238. Thesheet of recording paper passes through reverse feeding path 238, turnedupside-down and again fed to main feeding path 236, and while it isagain fed along main feeding path 236, printing is done on its rearsurface, and thereafter the sheet is guided to paper discharge tray 246or to paper discharge unit 108.

The sheet of recording paper printed in the above-described manner isguided to paper discharge tray 246 or to paper discharge unit 108, anddischarged to paper discharge tray 246 or to any of paper dischargetrays 110 of paper discharge unit 108.

Paper discharge unit 108 may perform a process of sorting a plurality ofprinted sheets of paper to be output to different discharge trays 110, aprocess of punching each sheet of recording paper or a process ofstapling the sheets of recording paper. Assume that a number of copiesof the printing are to be prepared. In that case, sheets of recordingpaper are sorted and discharged to paper discharge trays 110 such thateach tray 110 contains each set of printed sheets, and the set ofprinted sheets in each tray 110 is stapled or punched.

—Facsimile Mode—

In the following, an operation in the facsimile mode will be described.In the facsimile mode, the facsimile function is realized bytransmission and reception operations. In the transmission operation,document reading unit (scanner unit) 102 and FAX communication unit 160mainly operate. In the reception operation, FAX communication unit 160and image forming unit 104 mainly operate.

—Transmission Operation

In image forming apparatus 100, the facsimile mode is designated. Adocument placed on the platen is read by document reading unit 102 asimage data. The read image data is input to CPU 300 implemented, forexample, by a microcomputer shown in FIG. 3, the image data is subjectedto various image processing operations here, and the resulting imagedata is output to a FAX communication unit (FAX communication unit 160of FIG. 3).

FAX communication unit 160 of image forming apparatus 100 on thetransmitting side connects a designated transmitting side line to adesignated transmission destination. FAX communication unit 160 convertsthe image data to communication data in compliance with facsimiletransmission standard, and transmits the converted data to a facsimilemachine (such as an image forming apparatus having the facsimilefunction) on the receiving side.

—Communication Operation

When the line is connected, a FAX communication unit of the imageforming apparatus on the receiving side detects a communication requestsignal from FAX communication unit 160 of image forming apparatus 100 onthe transmitting side, and transmits an acknowledgement signal.Thereafter, by way of example, FAX communication units on thetransmitting and receiving sides pass performance information supportedby transmitting side and receiving side, determine highest possiblespeed of communication and method of coding/code correction of imagedata, and set the method of communication of modems. Then, using theimage signal format in compliance with the communication method, data istransmitted from FAX communication unit 160 of image forming apparatus100 on the transmitting side to the FAX communication unit of imageforming apparatus on the receiving side. When transmission ends, theline is disconnected.

—Reception Operation

When image forming apparatus 100 is on the receiving side, FAXcommunication unit 160 converts the received data to image data andpasses the data to an image forming unit 104. The received data may beconverted to image data at the image forming unit 104. The image formingunit 104 prints an image of a document represented by the image dataconverted from the received data on a sheet of recording paper, in amanner similar to the operation in the copy mode described above.

—Document Filing Mode—

In the following, an operation in the document filing mode will bedescribed. In the document filing mode, mainly document reading unit(scanner unit) 102 and image forming unit 104 operate.

In image forming apparatus 100, a document placed on the platen is readby document reading unit 102 as image data. The read image data is inputto CPU 300 and subjected to various image processing operations here.The resulting image data is stored in a storage device (hard disk drive302 as will be described later) provided in image forming apparatus 100.

The stored image data is read from the hard disk drive by the userdesignating the file name, and printed on a sheet of recording paper inthe similar manner as in the copy mode described above.

—Mail Mode (Scan-to-Mail)—

In the following, description will be given on an operation in the mailmode. In the mail mode, document reading unit (scanner unit) 102 andnetwork interface 304 mainly operate.

The image communication mode provided in image forming apparatus 100includes the facsimile mode and the electronic mail communication mode(mail mode). In the facsimile mode, image data is transmitted/receivedby public line through FAX communication unit 160 as described above. Inthe electronic mail communication mode (mail mode), the image data istransmitted/received by the Internet line in the form of an attachmentto an electronic mail, through network interface 304. Image formingapparatus 100 may further include Internet facsimile mode or imagetransfer mode (scan-to-PC folder). In the Internet facsimile mode, theimage data is transmitted/received by the Internet line through networkinterface 304. In the image transfer mode (scan-to-PC folder), the imagedata is transferred to a folder of a specific personal computer (PC)using a network line.

In image forming apparatus 100, a document placed on a platen is read bydocument reading unit 102 as image data. The read image data is input toCPU 300, and subjected to various image processing operations here. Theresulting image data is transmitted, attached to an electronic mail.

Different from the facsimile mode in which a telephone number oftransmission destination is designated, a mail address of thetransmission destination is designated in the mail mode.

[Image Forming Apparatus: Control Block Configuration]

Referring to FIG. 3, image forming apparatus 100 further includesoperation unit 120, ROM (Read Only Memory) 306, a hard disk drive(hereinafter denoted as HDD) 302, and an RAM (Random Access Memory) 308.Operation unit 120 allows setting of functions related to the copy mode,facsimile mode, document filing mode and mail mode. ROM 306 storesprograms and the like. HDD 302 is a non-volatile storage area capable ofstoring programs and data even when power is cut off. RAM 308 provides astorage area when a program is executed.

Image forming apparatus 100 further includes a bus 310 and CPU 300.Document reading unit 102, image forming unit 104, FAX communicationunit 160, operation unit 120, ROM 306, HDD 302, RAM 308, and CPU 300 areconnected to bus 310. CPU 300 realizes general functions as the imageforming apparatus.

HDD 302 stores files of image data of documents scanned by image formingapparatus 100, folder by folder, together with date and time of savingand name of the user who saved. Further, HDD 302 stores initial screenimage data of each operational mode.

ROM 306 stores programs and data necessary for controlling operations ofimage forming apparatus 100. The initial screen image data of eachoperational mode may be stored as data to be stored together with theprogram in ROM 306. CPU 300 controls image forming apparatus 100 inaccordance with the programs and data stored in ROM 306, and executescontrol related to various functions of image forming apparatus 100.

As shown in FIG. 3, a public line is connected fortransmitting/receiving image data, to FAX communication unit 160 ofimage forming apparatus 100. To network interface 304, a network line isconnected. To the network line, a computer or the like using imageforming apparatus 100 as a network-supported printer may be connected.To the network line, a computer or the like identified by a URL (UniformResource Locator) designated through the Internet may be connected. Whenconnected to the Internet, image forming apparatus 100 can obtainnecessary information through the Internet.

RAM 308 provides a function of a working memory for temporarily storingresults of operations and processes by CPU 300, and a function of aframe memory for storing image data.

CPU 300 controls document reading unit 102, image forming unit 104, ROM306, HDD 302, RAM 308 and touch-panel display 130 and display operationunit 140 forming operation unit 120, by executing a prescribed programor programs. Operation unit 120 communicates with CPU 300 through aninput/output interface.

Operation unit 120 is formed of a plate-shaped panel provided in aninclined manner to be easily viewable by the user. On a surface ofoperation unit 120, touch-panel display 130 is provided on the left sidearea, and display operation unit 140 (pilot lamp 142 and power key 144,energy-saving key 146 and home key 148 as hardware buttons) is providedon the right side area. Touch-panel display 130 and display operationunit 140 form operation unit 120 as one integrated body as a whole.

As described above, touch-panel display 130 is formed of display panel132 and touch-panel 134 arranged on display panel 132. On display panel132 of touch-panel display 130, a home screen image allowing selectionof an operational mode of image forming apparatus 100, current state ofimage forming apparatus 100, status of destination designation, andstatus of job processing are displayed. On a display area of displaypanel 132, selection buttons as software buttons are displayed. When aportion where the selection button is displayed is pressed, the pressedposition is detected by the touch-panel 134. By comparing the displayposition of the selection button and the position where the touch-panel134 is pressed using a program, selection of an operational mode,setting of a function, and instruction of an operation of image formingapparatus 100 become possible. In addition to such a touch operation(command input operation based on the position of pressing by the user),image forming apparatus 100 also allows gesture operation (command inputoperation based on trajectory of operation by the user) as describedabove.

Pilot lamp 142 of display operation unit 140 is, for example, an LED(Light Emitting Diode). It is turned on/off (/flickered) under thecontrol of CPU 300. When the user presses power key 144 providedseparate from a main power switch, image forming apparatus 100 makes atransition from a standby mode (in which, for example, only the FAXreceiving operation is possible with the main power on) to a normalmode, in which every operational mode of image forming apparatus 100 isusable. In this state, pilot lamp 142 is turned and kept on. If apredetermined time passes without any user operation, or if the userpresses energy-saving key 146, image forming apparatus 100 makes atransition from the normal mode to the energy saving mode. In the energysaving mode, only some of the operational modes of image formingapparatus 100 can be used. In this state, pilot lamp 142 flickers.Further, if the user presses energy-saving key 146 in the energy savingmode, the image forming apparatus 100 makes a transition from the energysaving mode to the normal mode. Home key 148 is a hardware key forreturning the display of touch-panel display 130 to the initial state(home screen image). The processes performed when power key 144,energy-saving key 146 and home key 148 are pressed are not limited tothe above.

In a hardware button (power key 144, energy-saving key 146 and home key148) of display operation unit 140, a key lamp or key lamps, whichis/are turned on/off (/flickered) under the control of CPU 300, may beembedded. By way of example, the key lamps provide a light ring on theedge of a circular key, or the key lamp lights a central portion of thekey. The key lamp is turned on at a timing when hardware buttons areallowed to be used as the operation device (at a timing when a processis executed if the hardware button is used).

Image forming apparatus 100 in accordance with the present embodimentincludes the four operational modes (copy mode, facsimile mode, documentfiling mode and mail mode) as described above. On touch-panel display130, software buttons for setting functions in respective operationalmodes are displayed, and buttons for setting a destination or a previewas an expected image, for example, are displayed as needed.

In different operational modes, different screen images are displayed ontouch-panel display 130. In order to allow the user to easily find arequired piece of information even in such a state, touch-panel display130 is divided into a plurality of areas (with the size of each areamade variable), and pieces of information are displayed in these areas.More specifically, in image forming apparatus 100, if an operationalmode is selected on the home screen image of touch-panel display 130provided as a main display operation device, the initial screen image ofeach operational mode is displayed. In the initial screen image, a basiclayout is such that the screen image is divided into five areas (“systemarea,” “function selecting area,” “preview area,” “action panel area,”and “task trigger area”) and arranged appropriately. Therefore, by auser operation starting from an upper left portion to a lower rightportion, easy setting is possible (since the flow lines of the user'sviewpoint and finger tip are similar to those in a conventional devicenot provided with such a large touch-panel display 130). Further,concepts of the pieces of information displayed on respective ones ofthe five areas are common among different operational modes, so thatsmooth operation by the user without any confusion becomes possible evenin different operational modes. Further, there are at least two displaymodes for the display of the “function selecting area,” and by changingthe area size, it is possible to change the size of “preview area” andthereby to accurately present the function setting information and thepreview information to the user. Further, it is possible to place the“preview area” at the center and the “function selecting area,” “actionpanel area” and “task trigger area” therearound, to select a function onthe area (“function selecting area”) placed on one side, to confirm theprocess realized by the selected function on the area at the center, andto request execution of the process on the area (“action panel area” and“task trigger area”) placed on the other side. In the following, thearrangement of basic layout will be described.

[Basic Layout Arrangement]

FIG. 4 shows a basic layout on touch-panel display 130 of image formingapparatus 100. Referring to FIG. 4, the basic layout oflandscape-oriented touch-panel display 130 (for example, of 1024pixels×600 pixels) includes system area 1000, preview area 3000,function setting/confirmation area 2000 (hereinafter referred to asfunction selecting area 2000), action panel area 4000 and task triggerarea 5000. Specifically, system area 1000 is arranged at the uppermostportion of the screen image, and preview area 3000 is arranged at thecenter of the screen image. Function selecting area 2000 is placed onthe left side of preview area 3000, and action panel area 4000 is placedon the right side of preview area 3000. Task trigger area 5000 is placedon the lower right side of preview area 3000. The number of areas is notlimited to five, the arrangement on the left and right sides is notlimited to the above, and the layout may be customized to facilitateuser operation. For instance, system area 1000 may be positioned at thelowermost portion of the screen image.

On system area 1000, pieces of information related to the current statusand state of image forming apparatus 100 are displayed. By way ofexample, on system area 1000, an operational mode name, an interruptionkey, a log-in user name, status of a currently processed job, state ofuse of an internal memory, time and the like are displayed.

On function selecting area 2000, a function selection menu (icons,buttons, setting item screen image, function list screen image and thelike) operated by the user for setting each function, switching displayand confirming setting, is displayed. The manner of display of functionselecting area 2000 is changed depending on whether it is in an iconmode, a regular mode or an express mode. In the icon mode, only theicons for setting functions are displayed in function selecting area2000, so as to ensure the widest preview area 3000. In the express mode,a large screen image allowing setting of functions at one time isdisplayed in function selecting area 2000, while preview area 3000 ismade the smallest. In the regular mode, the size of preview area 3000 ismedium size between that in the icon mode and that in the express mode.In function selecting area 2000, function names are displayed in text,together with the icons for setting functions.

In the regular mode, only the text of function names may be displayed(without displaying icons for function setting).

Switching among the icon mode, regular mode and express mode is donebased on an operation by the user. Specifically, the size of previewarea 3000 is changed in accordance with the user's operation. Sinceicons can transmit pieces of information to the user in a small area, itis preferred to prepare icons for all functions, so as to allow displayof preview area 3000 in a large size.

At a lower portion of function selecting area 2000, a group of changebuttons 2010 are provided, for changing style of display of functionselecting area 2000. Among the group of change buttons 2010, an iconmode entering button 2012, a “favorite” button 2014, a check button2016, a list button 2018, a regular mode entering button 2020, and anexpress mode entering button 2022 are provided. Icon mode enteringbutton 2012 is for displaying function selecting area 2000 in the iconmode. Favorite button 2014 is for displaying functions registered as“favorites.” Check button 2016 is for displaying a function of whichsetting has been changed. List button 2018 is for displaying a list ofall functions that can be set in the selected operational mode. Regularmode entering button 2020 is for displaying function selecting area 2000in the regular mode. Express mode entering button 2022 is for displayingfunction selecting area 2000 in the express mode. Details of these threedisplay modes (icon mode, regular mode and express mode) will bedescribed later.

If a large amount of information is to be displayed on functionselecting area 2000, pieces of information are displayed in anupward/downward scrollable manner. In that case, the group of changebuttons 2010 are not scrolled but constantly displayed at the lowermostportion of function selecting area 2000.

In preview area 3000, an image of expected document output (finishedform) is displayed. Specifically, an image is displayed using dummy dataor scanned data. Every time the user designates the manner of finish,the image displayed on preview area 3000 changes. Preview area 3000 hastwo display modes. One is a virtual mode before scanning, in whichfinished form of a dummy image is displayed. Another display mode is ascan-in mode after scanning, in which finished form of the actual imageis displayed. The virtual mode has two types, that is, before setting anoriginal document and after setting an original document.

At a lower portion of preview area 3000, a group of preview changingbuttons 3010 are provided, for changing the style of display of previewarea 3000. Among the group of preview changing buttons 3010, a left-turnbutton 3016, a right-turn button 3018, and a zoom bar 3020 are provided.Left-turn button 3016 turns the preview 90 degrees to the left, andright-turn button 3018 turns the preview 90 degrees to the right. Inaddition to these buttons, a color changing button 3012 and previewoperation button 3014, for example, are provided.

When left-turn button 3016 is touch-operated once, the preview is turned90 degrees to the left, and when touch-operated twice, the preview isturned 180 degrees to the left (vertically flipped). Similarly, when theimage of finished document displayed on the preview area isgesture-operated (when the document image is rotated 180 degreescounterclockwise by one's finger), the preview is turned 180 degrees tothe left and vertically flipped.

When right-turn button 3018 is touch-operated once, the preview isturned 90 degrees to the right, and when touch-operated twice, thepreview is turned 180 degrees to the right (vertically flipped).Similarly, when the image of finished document displayed on the previewarea is gesture-operated (when the document image is rotated 180 degreesclockwise by one's finger), the preview is turned 180 degrees to theright and vertically flipped.

When a plus button 3020A of zoom bar 3020 is touch-operated or if bar3020C is gesture-operated (slid) to the side of plus button 3020A, thepreview is displayed in an enlarged size. Similarly, when the image offinished document displayed on the preview area is gesture-operated(when the document image is pinched-out/pinched-open by finger tips),the preview is displayed in an enlarged size.

When a minus button 3020B of zoom bar 3020 is touch-operated or if bar3020C is gesture-operated (slid) to the side of minus button 3020B, thepreview is displayed in a reduced size. Similarly, when the image offinished document displayed on the preview area is gesture-operated(when the document image is pinched-in/pinched-close by finger tips),the preview is displayed in a reduced size.

If the number of pages of the document image to be displayed on previewarea 3000 is large, a display page selection button (a page number inputbutton, page feed button, page return button, single page displaybutton, plural page display button or the like) that can betouch-operated may be displayed. Page feed and page return of thepreviewed document is also possible by a gesture-operation (flick) ofthe document image. If the document image displayed on preview area 3000is large, a scroll bar that can be touch-operated or gesture-operatedmay be displayed.

On action panel area 4000, pieces of information related to assistance,guidance and suggestion related to the operation are displayed. Onaction panel area 4000, if, for instance, a user selects a specificfunction, functions related to the selected function may be displayed,other functions related to the selected function in object-orientedmanner may be displayed, or functions selected in the past by the useror a user of a group to which the user belongs in relation to theselected function may be displayed as “recommended functions.”

On task trigger area 5000, trigger items operated by the user toactually operate image forming apparatus 100 when all settings are donefor the operational mode are displayed. By way of example, a startbutton (software button) is displayed for starting a process. In anoperational mode involving printing (other than facsimile transmission),information related to run out of consumables is also displayed on tasktrigger area 5000, since it leads to a task failure.

Here, it is preferred to display the start button only when the stateallows pressing of the start button. The state that allows pressing ofthe start button refers to a state in which all settings have been done,and consumables (recording paper and toner) are available, in theoperational mode involving printing. In the facsimile mode(transmission) as an operational mode not involving printing, it is astate in which settings of all transmission parameters including adestination have been done.

The positions where these five areas are arranged are not changed evenwhen the operational mode is changed (not changed in the initial screenimage of any operational mode). Similar to the switched display in theicon mode/regular mode/express mode of function selecting area 2000 (andpreview area 3000), the size of each area is changed, reduced/enlargedin the lateral direction (longitudinal direction) of touch-paneldisplay.

These five areas are arranged in consideration of the flow line ofuser's viewpoint and the flow line of user's operation, in addition tothe user interface of conventional devices. With such an arrangement,the user's viewpoint moves from upper left to lower right, and the useroperation (finger tip of the dominant hand) moves from upper left tolower right. This advantageously enables a user-friendly operation.

For making a transition from one operational mode to another, home key148 is pressed, to select another operational mode on the home screenimage. In this manner, the operational mode is switched through the homescreen image.

As described above, image forming apparatus 100 is provided withtouch-panel display 130 displaying pieces of information inconsideration of flow lines of user's viewpoint and user's operation. Ontouch-panel display 130, there are at least two display modes for thedisplay of function selecting area 2000 (in the present embodiment,three display modes), and by switching the display modes, the size offunction selecting area 2000 and the size of preview area 3000 arechanged, so as to appropriately present information to the user. Such adisplay process is realized by software executed by using the hardwareconfiguration described above. The software configuration will bedescribed.

[Software Configuration]

FIG. 5 is a flowchart representing a control structure of a programexecuted by CPU 300 of image forming apparatus 100. CPU 300 of imageforming apparatus 100 executes, in parallel with the program, a programfor realizing general functions of an image forming apparatus. Theprogram, however, is not directly related to the characteristic portionof the present invention and, therefore, details thereof will not bedescribed here.

Referring to FIG. 5, at step (hereinafter “step” will be denoted by S)10000, CPU 300 of image forming apparatus 100 (hereinafter simplyreferred to as CPU 300) determines whether or not image formingapparatus 100 is powered on. Here, it is assumed that the main power foroperating CPU 300 has been on, and when power key 144 is pressed, CPU300 determines that image forming apparatus 100 is powered on. Thedetermination of YES may be made if the main power is turned on, atS10000. If it is determined that image forming apparatus 100 is poweredon (YES at S10000), the process proceeds to S10010. Otherwise (NO atS10000), the process of S10000 is repeated until it is determined thatimage forming apparatus 100 is powered on.

At S10010, CPU 300 displays a warm-up screen image on touch-paneldisplay 130. While the warm-up screen image is displayed on touch-paneldisplay 130, by way of example, a system check process and the processof supplying electric power to the heater to heat heating roller 248 areexecuted.

At S10020, CPU 300 determines whether or not warm-up is complete. If itis determined that warm-up is complete (YES at S10020), the processproceeds to S10030. Otherwise (NO at S10020), the process of S10020 isrepeated until warm-up is complete.

At S10030, CPU 300 displays the home screen image on touch-panel display130. At S10040, CPU 300 determines whether or not an operational mode isselected. CPU 300 determines that an operational mode is selected whenan icon (an icon representing an operational mode) displayed on the homescreen image is touched, tapped or double-tapped. If it is determinedthat an operational mode is selected (YES at S10040), the processproceeds to S10050. Otherwise (NO at S10040), the process returns toS10030, and the processes of S10030 and S10040 are executed. As to theicon operation, any gesture operation other than touching, tapping anddouble-tapping is not excluded. Any touch-operation or gesture-operationon touch-panel display 130 may be done. Simple description of “pressing”may refer to any of these operations.

At S10050, CPU 300 reads the initial screen image data of the selectedoperational mode, which is among the initial screen image data stored,for example, in HDD 302. At S10060, CPU 300 displays the initial screenimage of the selected operational mode using the read initial screenimage data, on touch-panel display 130.

At S10070, CPU 300 determines whether or not a full list display isrequested. By way of example, if a list button 2018 (see FIG. 4)displayed on function selecting area 2000 of the initial screen image ofeach operational mode is touched, tapped or double-tapped, CPU 300determines that the full list display is requested. The full list refersto a list of functions selectable in the selected operational mode. Ifit is determined that the full list display is requested (YES atS10070), the process proceeds to S10080. Otherwise (NO at S10070), theprocess proceeds to S10090.

At S10080, CPU 300 displays the list of functions selectable in theselected operational mode on touch-panel display 130. Then, if aprescribed time passed, or if “RETURN” button is pressed by the user,the process returns to S10070. When one of the functions displayed inthe full list is selected, a screen image for setting that function isdisplayed on touch-panel display 130 (for example, a setting button2148, which will be described later, is displayed).

At S10090, CPU 300 determines whether or not change in the display modeis requested. By way of example, if any of icon mode entering button2012, regular mode entering button 2020 and express mode entering button2022 (see FIG. 4) displayed on function selecting area 2000 of theinitial screen image of each operational mode is touched, tapped ordouble-tapped, CPU 300 determines that the change in display mode isrequested. If the present display mode is already the requested displaymode, no process is performed. If it is determined that change in thedisplay mode is requested (YES at S10090), the process proceeds toS10100. Otherwise (NO at S10090), the process proceeds to S10110.

At S10100, CPU 300 displays function selecting area 2000 in the selecteddisplay mode, on touch-panel display 130. Then, the process returns toS10070.

At S10110, CPU 300 determines whether or not any request is input in theselected operational mode. If it is determined that a user request isinput (YES at S10110), the process proceeds to S10120. Otherwise (NO atS10110), the process proceeds to S10130.

At S10120, CPU 300 executes the process requested by the user, in imageforming apparatus 100. Then, the process ends.

At S10130, CPU 300 determines whether or not the home key is pressed. Ifit is determined that the home key is pressed (YES at S10130), theprocess returns to S10030. Otherwise (NO at S10130), the process returnsto S10110, and the process of S10110 is repeated until it is determinedthat a user request is input.

It is also possible to display a log-in screen image at the completionof warm-up (YES at S10020). Though the log-in operation after completionof warm-up is not described in the following, it is assumed that log-inis required of the user to use image forming apparatus 100.

Further, the request input by the user at S10110 may be a request beforeprinting that does not necessarily cause the actual printing by imageforming apparatus 100. Specifically, the request may include a change inthe display mode of function selecting area 2000, function setting onfunction selecting area 2000, and a change in the manner of displayingthe preview on preview area 3000. If such a request before printing ismade, corresponding operation is done at S10120, and after S10120, theprocess returns to S10110 to wait for an input of a further request(eventually the request for printing).

[Operation]

The operation of image forming apparatus 100 in accordance with thepresent embodiment based on the configuration and flowchart as abovewill be described with reference to the exemplary displays ontouch-panel display 130 shown in FIGS. 6 to 21.

—Home Screen Image Display Operation—

When the user presses power key 144 of image forming apparatus 100 (YESat S10000), the warm-up screen image is displayed on touch-panel display130 (S10010) until warm-up is complete (NO at S10020). At this time, itis preferred that image forming apparatus 100 prepares pieces ofinformation that can be displayed even during system check and usefulfor the user who is going to use image forming apparatus 100, and thatthe warm-up screen image including such pieces of information isdisplayed on touch-panel display 130.

When warm-up is complete (YES at S10020), the home screen image isdisplayed on touch-panel display 130 (S10030). At this time, ontouch-panel display 130, a home screen image 6000 such as shown in FIG.6 is displayed. On home screen image 6000, not all of the five areas ofthe layout described above are displayed. As shown in FIG. 6, on homescreen image 6000, icons (icons representing operational modes) allowingselection of an operational mode are displayed on most part oftouch-panel display 130, regardless of the five areas.

Referring to FIG. 6, home screen image 6000 includes a home system area6100 corresponding to the system area described above, an icon displayarea 6200, an icon display switching tub-button 6300, and a memo displayarea 6400.

On home system area 6100, an area 6102 displaying an icon representingthe home screen image, an area 6104 displaying the name of the displayedscreen image, an area 6106 displaying the logged-in user name, an area6108 displaying a log-out button (software button), and an area 6110displaying the current time, are arranged.

On icon display area 6200, icons 6210-6274 representing operationalmodes are displayed together with the names or abbreviations of theoperational modes. The name or abbreviation of the operational mode isnot indispensable. In the present embodiment, there are at least fouroperational modes (copy mode, facsimile mode, document filing mode, andmail mode). Therefore, an icon 6242 for selecting the copy mode, an icon6232 for selecting the facsimile mode, an icon 6254 for selecting thedocument filing mode and an icon 6240 for selecting the mail mode aredisplayed on icon display area 6200. In FIG. 6, icons for selectingother operational modes, icons for selecting other setting modes (forexample, system setting and language setting), and icons for displayingother screen images (for example, job status) are also displayed.

As shown in FIG. 6, in icon display area 6200, icons on the centralcolumn (for example, icons 6240, 6242 and 6244) are displayed largerthan icons on the left and right sides thereof (for example, icons 6230and 6250 with respect to icon 6240, icons 6232 and 6252 with respect toicon 6242, and icons 6234 and 6254 with respect to icon 6244). In icondisplay area 6200, icons at the central row (for example, icons 6232,6242 and 6252) are displayed larger than icons on the upper and lowersides thereof (for example, icons 6230 and 6234 with respect to icon6232, icons 6240 and 6244 with respect to icon 6242, and icons 6250 and6254 with respect to icon 6252). In this manner, in icon display area6200, the icons are displayed to be horizontally and verticallysymmetrical in size, with the size being the largest at the center(center at the central column).

When the user makes a flick operation to the left with his/her finger onicon display area 6200 displayed on the screen of touch-panel display130, icons displayed on the screen move as if they flow in the directionindicated by an arrow 6010. When the user makes a flick operation to theright, icons displayed on the screen move as if they flow in thedirection indicated by an arrow 6020. The distance of movement isdetermined, for example, in accordance with the width of movement of thefinger tip in the flick operation. The distance of movement may be aprescribed distance set in advance for one flick operation. If a mannerof display in which a plurality of icons are arranged on a virtualcylinder is adopted for icon display area 6200, it becomes possible todisplay the icons in an endless manner.

On memo display area 6400, a piece of maintenance information or thelike to be notified to every user of image forming apparatus 100 isdisplayed.

—Operation of Displaying Initial Screen Image in Each Operational Mode—

—Copy Mode

If icon 6242 shown in FIG. 6 is touched, tapped or double tapped by thefinger tip of a user, it is determined that the operational mode isselected (YES at S10040), and that the selected operational mode is thecopy mode. Using the copy initial screen image data read from HDD 302 orthe like, the initial screen image of copy mode is displayed ontouch-panel display 130 (S10050, S10060). By way of example, an initialscreen image 7100 for the copy mode shown in FIG. 7 is displayed ontouch-panel display 130. As shown in FIG. 7, copy mode initial screenimage 7100 is divided into five areas of the layout described above, onwhich pieces of information are displayed. Function selecting area 2000in copy mode initial screen image 7100 is displayed in the regular mode.

Referring to FIG. 7, on system area 1000 of copy mode initial screenimage 7100, an area 1102 indicating the selected operational mode (here,copy mode), an area 1104 displaying sub information related to theselected operational mode, an area 1106 displaying the logged-in username, an area 1108 displaying a log-out button (software button), anarea 1110 displaying the job status of the currently executed job, anarea 1112 displaying a button related to the job status (softwarebutton), an area 1114 displaying the communication state, and an area1116 indicating the current time, are arranged.

In area 1102, a name and/or icon representing the operational mode isdisplayed. It is preferred that if area 1102 is touched, tapped ordouble-topped, a menu showing operational modes is pulled-down, allowingswitching of the operational mode (the same applies to other operationalmodes).

In area 1104, an interruption key (software button) is displayed as subinformation. If the interruption key is touched, tapped ordouble-tapped, an interruption process can be executed in the copy mode.

In area 1106, job status of the currently executed job is indicated byan icon. If the job status is touched, tapped or double-tapped, detailedinformation of job status is displayed. Further, it is preferred todisplay a button or the like to stop the selected job in area 1112.

In function selecting area 2000 of copy mode initial screen image 7100,a function selection menu allowing selection by the user in the copymode and the group of change buttons 2010 described above are displayed.In the screen image shown in FIG. 7, the function selection menu isdisplayed in the regular mode.

As shown in FIG. 7, the function selection menu displayed in the regularmode includes a group of icons 2100 and a group of texts 2120. In thefunction selection menu displayed on function selecting area 2000,corresponding to an icon 2102 for setting the number of copies, a text2122 showing the set contents is displayed. Corresponding to an icon2104 for setting color mode, a text 2124 showing the set contents isdisplayed. Corresponding to an icon 2106 for setting copy density, atext 2126 showing the set contents is displayed. Corresponding to anicon 2108 for setting copy magnification, a text 2128 showing the setcontents is displayed. Corresponding to an icon 2110 for settingdocument type, a text 2130 showing the set contents is displayed.Corresponding to an icon 2112 for setting paper type, a text 2132showing the set contents is displayed. Corresponding to an icon 2114 forimage edition, a text 2134 showing the set contents is displayed.Corresponding to an icon 2116 for layout edition, a text 2136 showingthe set contents is displayed.

As described above, further items on the function setting menu may bedisplayed in upward/downward scrollable manner, with the displayposition of group of change buttons 2010 fixed. It is possible to switchthe items displayed on the function setting menu including the itemshidden at the upper or lower portion and not displayed, either by thetouch-operation (scroll operation) or gesture-operation (upward/downwardflick operation).

Here, image edition refers to image edition of one page of document. Alower layer menu thereof includes frame erasure, print menu, watermark,user stamp and the like. The layout edition refers to image edition of aplurality of pages of the document. The lower layer menu thereofincludes page collection, margin, page movement, centering and the like.The lower layer menu of the displayed function selection menu appears ontouch-panel display 130 if any of icons 2102 to 2116 or texts 2122 to2136 is touched, tapped or double-tapped.

In preview area 3000 of copy mode initial screen image 7100, an image ofexpected document output (finished form) 3100 and the group of previewchanging buttons 3010 described above are arranged. Here, image 3100 isdisplayed using dummy data or scanned data. Every time the user changesthe function setting menu of function selecting area 2000, image 3100 ischanged and displayed on preview area 3000 (preview display is changed).

In action panel area 4000 of copy mode initial screen image 7100, piecesof information related to assistance, guidance and suggestion related tothe copy operation are displayed. As shown in FIG. 7, recommendedfunctions in the copy mode selected by the user are displayed. In actionpanel area 4000, an area 4100 showing the contents of displayedinformation, and areas 4102 to 4106 showing, as texts, the recommendedfunctions and serving as software buttons are arranged.

When area 4102 is touched, tapped or double-tapped, detailed informationof energy-saving copy is pulled-down and displayed. Here, a softwarebutton allowing transition to a function setting screen image fordouble-sided copy is displayed, together with a text message of, forexample, “double-sided copy saves paper.” At the same time, a softwarebutton allowing transition to a function setting screen image for pagecollection is displayed, together with a text message of “collectiveprinting of pages saves paper.” Further, a software button allowingtransition to a function setting screen image for saddle stitch isdisplayed, together with a text message of “printing for bookbindingavailable.”

In task trigger area 5000 of copy mode initial screen image 7100, agroup of execution buttons 5100 are displayed. The group of executionbuttons 5100 includes a scan-in key 5102, a clear all key 5104, amonochrome start key 5106 and a color start key 5108. These are allsoftware buttons. Scan-in key 5102 is for operating image formingapparatus 100 to scan a document and obtain image data. Clear all key5104 is for clearing set function or functions. Monochrome start key5106 is for operating image forming apparatus 100 to scan a document andstart copying in black and white. Color start key 5108 is for operatingimage forming apparatus 100 to scan a document and start color copying.

If a user inputs a request (YES at S10110) on copy mode initial screenimage 7100 displaying pieces of information in five divided areas, acopy process is executed in accordance with the request (S10120).

—Mail Mode

If icon 6240 shown in FIG. 6 is touched, tapped or double tapped by thefinger tip of a user, it is determined that the operational mode isselected (YES at S10040), and that the selected operational mode is themail mode (NO at S10050, “mail” at S10060). Using the mail initialscreen image data read from HDD 302 or the like, the initial screenimage of mail mode is displayed on touch-panel display 130 (S10050,S10060). By way of example, an initial screen image 7200 for the mailmode shown in FIG. 8 is displayed on touch-panel display 130. As shownin FIG. 8, mail mode initial screen image 7200 is divided into fiveareas of the layout described above, on which pieces of information aredisplayed.

Referring to FIG. 8, on system area 1000 of mail mode initial screenimage 7200, an area 1202 indicating the selected operational mode (here,mail mode), an area 1204 displaying sub information related to theselected operational mode, an area 1206 displaying the logged-in username, an area 1208 displaying a log-out button (software button), anarea 1214 displaying communication state, and an area 1216 indicatingthe current time, are arranged.

In area 1204, a key (software button) for adding a job is displayed, asthe sub information. If the interruption key is touched, tapped ordouble-tapped, a process for designating a job to be added in the mailmode can be executed.

In function selecting area 2000 of mail mode initial screen image 7200,a function selection menu allowing selection by the user in the mailmode and the group of change buttons 2010 described above are displayed.In the screen image shown in FIG. 8, the function selection menu isdisplayed in the regular mode.

As shown in FIG. 8, the function selection menu displayed in the regularmode includes a group of icons 2200 and a group of texts 2220. In thefunction selection menu displayed on function selecting area 2000,corresponding to an icon 2202 for setting the color mode of a documentto be transmitted as an attachment file of a mail, a text 2222 showingthe set contents is displayed. Corresponding to an icon 2204 for settingthe density of a document to be transmitted as an attachment file of amail, a text 2224 showing the set contents is displayed. Correspondingto an icon 2206 for setting the magnification of a document to betransmitted as an attachment file of a mail, a text 2226 showing the setcontents is displayed. Corresponding to an icon 2208 for setting thetype of a document to be transmitted as an attachment file of a mail, atext 2228 showing the set contents is displayed.

As described above, further items on the function setting menu may bedisplayed in upward/downward scrollable manner, with the displayposition of group of change buttons 2010 fixed. It is possible to switchthe items displayed on the function setting menu including the itemshidden at the upper or lower portion and not displayed, either by thetouch-operation (scroll operation) or gesture-operation (upward/downwardflick operation).

Further, in addition to the function selection menu, on functionselecting area 2000 of mail mode initial screen image 7200, a button2240 for displaying an address book used for designating a mail address,a button 2242 for designating a mail subject, a button 2244 fordesignating a file to be attached to a mail, and a button 2246 forinputting a main body of a mail are displayed.

When button 2240 is touched, tapped or double-tapped, from address booksstored in image forming apparatus 100, only the destinations having mailaddresses stored are extracted and a resulting address book isdisplayed.

When button 2242 is touched, tapped or double-tapped, a text inputscreen image is displayed, allowing input of a subject of the mail. Whenbutton 2244 is touched, tapped or double-tapped, a file name designatingscreen image is displayed, allowing designation of a file name. Whenbutton 2246 is touched, tapped or double-tapped, a text input screenimage is displayed, allowing input of a main body of the mail.

In preview area 3000 of mail mode initial screen image 7200, an image ofexpected document output (finished form) 3200 is arranged. Here, image3200 is displayed using dummy data or scanned data. Every time the userchanges the function setting menu of function selecting area 2000, image3200 is changed and displayed on preview area 3000 (preview display ischanged).

In addition to image 3200, in preview area 3000 of mail mode initialscreen image 7200, a button 3202 for inputting a mail destination isdisplayed. When button 3202 is touched, tapped or double-tapped, a textinput screen image is displayed, allowing direct input of a maildestination, or selection of a mail destination from an address book.

In action panel area 4000 of mail mode initial screen image 7200, piecesof information related to assistance, guidance and suggestion related tothe mail operation are displayed. As shown in FIG. 8, recommendedfunctions in the mail mode selected by the user are displayed. In actionpanel area 4000, an area 4200 showing the contents of displayedinformation, and areas 4202 to 4204 showing, as texts, the recommendedfunctions and serving as software buttons are arranged.

When area 4202 is touched, tapped or double-tapped, detailed informationof multicast mail transmission is pulled-down and displayed. When area4204 is touched, tapped or double-tapped, detailed information relatedto an operation of reducing the size of data to be attached to the mailis pulled-down and displayed. When area 4206 is touched, tapped ordouble-tapped, detailed information related to an operation of saving adocument to be transmitted attached to a mail in HDD 302 is pulled-downand displayed.

In task trigger area 5000 of mail mode initial screen image 7200, agroup of execution buttons 5200 are displayed. The group of executionbuttons 5200 includes a scan-in key 5202, a clear-all key 5204, and atransmission start key 5206. These are all software buttons. Scan-in key5202 is a button for operating image forming apparatus 100 to scan adocument and obtain image data. Clear all key 5204 is a button forclearing set function or functions. Transmission start key 5206 is abutton for operating image forming apparatus 100 to scan a document andtransmit it as an attachment to a mail.

If a user inputs a request (YES at S10110) on mail mode initial screenimage 7200 displaying pieces of information in five divided areas, amail process is executed in accordance with the request (S10120).

—Fax Mode

If icon 6232 shown in FIG. 6 is touched, tapped or double tapped by thefinger tip of a user, it is determined that the operational mode isselected (YES at S10040), and that the selected operational mode is theFAX mode. Using the FAX initial screen image data read from HDD 302 orthe like, the initial screen image of FAX mode is displayed ontouch-panel display 130 (S10050, S10060). By way of example, an initialscreen image 7300 for the FAX mode shown in FIG. 9 is displayed ontouch-panel display 130. As shown in FIG. 9, FAX mode initial screenimage 7300 is divided into five areas of the layout described above, onwhich pieces of information are displayed.

Referring to FIG. 9, on system area 1000 of FAX mode initial screenimage 7300, an area 1302 indicating the selected operational mode (here,FAX mode), an area 1304 displaying sub information related to theselected operational mode, an area 1306 displaying the logged-in username, an area 1308 displaying a log-out button (software button), anarea 1310 displaying a volume adjustment button at the time of on-hook,an area 1312 displaying free memory space, an area 1314 displayingcommunication state, and an area 1316 indicating the current time, arearranged.

In area 1304, a key (software button) for adding a job is displayed, asthe sub information. If the interruption key is touched, tapped ordouble-tapped, a process for designating a job to be added in the FAXmode can be executed.

When the volume adjustment button displayed in area 1310 is touched,tapped or double-tapped, a slide bar for adjusting volume at the time ofon-hook is displayed.

In function selecting area 2000 of FAX mode initial screen image 7300, afunction selection menu allowing selection by the user in the FAX modeand the group of change buttons 2010 described above are displayed. Inthe screen image shown in FIG. 9, the function selection menu isdisplayed in the regular mode.

As shown in FIG. 9, the function selection menu displayed in the regularmode includes a group of icons 2300 and a group of texts 2320. In thefunction selection menu displayed on function selecting area 2000,corresponding to an icon 2302 for setting the density of a FAX document,a text 2322 showing the set contents is displayed. Corresponding to anicon 2304 for setting the type of FAX document, a text 2324 showing theset contents is displayed. Corresponding to an icon 2306 for imageedition, a text 2326 showing the set contents is displayed.Corresponding to an icon 2308 for layout edition, a text 2328 showingthe set contents is displayed. For an icon 2310 for displaying result ofFAX communication, corresponding text 2330 is displayed. For an icon2312 for printing information of FAX transmission source on a FAXdocument, corresponding text 2332 is displayed. For an icon 2314 fordisplaying information stored in a memory box, corresponding text 2334is displayed.

As described above, further items on the function setting menu may bedisplayed in upward/downward scrollable manner, with the displayposition of group of change buttons 2010 fixed. It is possible to switchthe items displayed on the function setting menu including the itemshidden at the upper or lower portion and not displayed, either by thetouch-operation (scroll operation) or gesture-operation (upward/downwardflick operation).

Further, in addition to the function selection menu, on functionselecting area 2000 of FAX mode initial screen image 7300, a button 2340for displaying an address book used to designate a telephone number ofFAX destination is displayed.

When button 2340 is touched, tapped or double-tapped, from address booksstored in image forming apparatus 100, only the destinations having FAXtelephone numbers stored are extracted and a resulting address book isdisplayed.

In preview area 3000 of FAX mode initial screen image 7300, an image ofexpected document output (finished form) 3300 is arranged. Here, image3300 is displayed using dummy data or scanned data. Every time the userchanges the function setting menu of function selecting area 2000, image3300 is changed and displayed on preview area 3000 (preview display ischanged).

In addition to image 3300, in preview area 3000 of FAX mode initialscreen image 7300, a button 3302 for inputting a FAX destination isdisplayed. When button 3302 is touched, tapped or double-tapped, a textinput screen image is displayed, allowing direct input of a FAXdestination, or selection of a FAX destination from an address book.

In action panel area 4000 of FAX mode initial screen image 7300, piecesof information related to assistance, guidance and suggestion related tothe FAX operation are displayed. As shown in FIG. 9, recommendedfunctions in the FAX mode selected by the user are displayed. In actionpanel area 4000, an area 4300 showing the contents of displayedinformation, and areas 4302 to 4304 showing, as texts, the recommendedfunctions and serving as software buttons are arranged.

When area 4302 is touched, tapped or double-tapped, detailed informationof multicast FAX transmission is pulled-down and displayed. When area4304 is touched, tapped or double-tapped, detailed information relatedto an operation of reducing the size of data to be transmitted by FAX ispulled-down and displayed. When area 4306 is touched, tapped ordouble-tapped, detailed information related to an operation of saving adocument to be transmitted by FAX in HDD 302 is pulled-down anddisplayed.

In task trigger area 5000 of FAX mode initial screen image 7300, a groupof execution buttons 5300 are displayed. The group of execution buttons5300 includes a scan-in key (software button) 5302, a clear-all key(software button) 5304, a transmission start key (software button) 5306and a check box 5308. Scan-in key 5302 is a button for operating imageforming apparatus 100 to scan a document and obtain image data. Clearall key 5304 is a button for clearing set function or functions.Transmission start key 5306 is a button for operating image formingapparatus 100 to scan a document and transmit it by FAX. Check box 5308is used for designating direct transmission.

If a user inputs a request (YES at S10110) on FAX mode initial screenimage 7300 displaying pieces of information in five divided areas, a FAXprocess is executed in accordance with the request (S10120).

—Document Filing Mode

If icon 6254 shown in FIG. 6 is touched, tapped or double-tapped by thefinger tip of a user, it is determined that the operational mode isselected (YES at S10040), and that the selected operational mode is thedocument filing mode.

Here, it is often the case that the file list stored in HDD 302 is readand the screen image of file reading process in the document filing modeis displayed on touch-panel display 130. In the following, the initialscreen image in the document filing mode displayed on touch-paneldisplay 130 after a file to be read from HDD 302 is selected by the userusing the screen image of file reading will be described.

Using the initial screen image data of the document filing mode readfrom HDD 302 or the like, an initial screen image of the document filingmode is displayed on touch-panel display 130 (S10050, S10060). By way ofexample, on touch-panel display 130, an initial screen image 7500 ofdocument filing mode shown in FIG. 10 is displayed. As shown in FIG. 10,the initial screen image 7500 of the document filing mode is dividedinto five areas of the layout described above, on which pieces ofinformation are displayed. Function selecting area 2000 in initialscreen image 7500 of the document filing mode is displayed in theregular mode.

Referring to FIG. 10, on system area 1000 of initial screen image 7500of the document filing mode, an area 1502 indicating the selectedoperational mode (here, document filing mode), an area 1506 displayingthe logged-in user name, an area 1508 displaying a log-out button(software button), an area 1510 displaying the job status of thecurrently executed job, an area 1512 displaying a button related to thejob status (software button), an area 1514 displaying the communicationstate, and an area 1516 indicating the current time, are arranged.

In area 1510, job status of the currently executed job is indicated byan icon. If the job status is touched, tapped or double-tapped, detailedinformation of job status is displayed. Further, it is preferred todisplay a button or the like to stop the selected job in area 1512.

In function selecting area 2000 of initial screen image 7500 of thedocument filing mode, a function selection menu allowing selection bythe user in the document filing mode and the group of change buttons2010 described above are displayed. In the screen image shown in FIG.10, the function selection menu is displayed in the regular mode.

As shown in FIG. 10, the function selection menu displayed in theregular mode includes a group of icons 2500 and a group of texts 2520.In the function selection menu displayed on function selecting area2000, corresponding to an icon 2502 for setting the number of printingthe document read in the document filing mode, a text 2522 showing theset contents is displayed. Corresponding to an icon 2504 for settingcolor mode of the document read in the document filing mode, a text 2524showing the set contents is displayed. Corresponding to an icon 2506 forsetting density of the document read in the document filing mode, a text2526 showing the set contents is displayed. Corresponding to an icon2508 for setting magnification of the document read in the documentfiling mode, a text 2528 showing the set contents is displayed.Corresponding to an icon 2510 for setting the type of the document readin the document filing mode, a text 2530 showing the set contents isdisplayed. Corresponding to an icon 2512 for setting the type ofrecording paper for printing the document read in the document filingmode, a text 2532 showing the set contents is displayed. Correspondingto an icon 2514 for editing images of the document read in the documentfiling mode, a text 2534 showing the set contents is displayed.Corresponding to an icon 2516 for editing layout of the document read inthe document filing mode, a text 2536 showing the set contents isdisplayed.

As described above, further items on the function setting menu may bedisplayed in upward/downward scrollable manner, with the displayposition of group of change buttons 2010 fixed. It is possible to switchthe items displayed on the function setting menu including the itemshidden at the upper or lower portion and not displayed, either by thetouch-operation (scroll operation) or gesture-operation (upward/downwardflick operation).

In preview area 3000 of initial screen image 7500 of the document filingmode, an image of expected document output (finished form) 3500 and thegroup of preview changing buttons 3010 described above are arranged.Here, image 3500 is displayed using dummy data or scanned data. Everytime the user changes the function setting menu of function selectingarea 2000, image 3500 is changed and displayed on preview area 3000(preview display is changed).

In action panel area 4000 of initial screen image 7500 of the documentfiling mode, pieces of information related to assistance, guidance andsuggestion related to the document filing operation are displayed. Asshown in FIG. 11, recommended functions in the document filing modeselected by the user are displayed. In action panel area 4000, an area4500 showing the contents of displayed information, and areas 4502 to4506 showing, as texts, the recommended functions and serving assoftware buttons are arranged.

In task trigger area 5000 of initial screen image 7500 of the documentfiling mode, a group of execution buttons 5500 are displayed. The groupof execution buttons 5500 includes a print start key (software button)5502 and a check box 5504. Print start key 5502 is for operating imageforming apparatus 100 to print a document. Check box 5504 is used fordesignating erasure of the file from HDD 302 after printing.

If a user inputs a request (YES at S10110) on initial screen image 7500of the document filing mode displaying pieces of information in fivedivided areas, a document filing process is executed in accordance withthe request (S10120).

—Operation in Copy Mode—

In the following, description will be given assuming that theoperational mode is the copy mode. Operations in other operational modes(mail mode, FAX mode and document filing mode) are similar.

—Operation to Enter Icon Mode

In copy mode initial screen image 7100 in which function selecting area2000 is displayed in the regular mode shown in FIG. 7, or in copy modeinitial screen image in which function selecting area 2000 is displayedin the express mode, which will be described later, if icon modeentering button 2012 is touched, tapped or double-tapped, the initialscreen image of function selecting area 2000 that has been displayed inthe regular mode or express mode on touch-panel display 130 makes atransition to the initial screen image displayed in the icon mode. Anexemplary display on touch-panel display 130 at this time is as shown inFIG. 11.

As shown in FIG. 11, the display mode of function selecting area 2000 ischanged to the icon mode. As the function selection menu, the group oftexts 2120 are not shown and only the group of icons 2100 are displayed.Specifically, function selecting area 2000 here consists of group ofchange buttons 2010 and group of icons 2100 of the function selectionmenu. At a portion where the group of texts 2120 have been displayed,images of expected document output (finished form) 3110 are displayed,as preview area 3000. The size of function selecting area 2000 (morespecifically, the width in the longitudinal direction of touch-paneldisplay 130) is made narrower and the size of preview area 3000 (morespecifically, the width in the longitudinal direction of touch-paneldisplay 130) is made wider, and images 3110 corresponding to two pagesare displayed.

As described above, in the icon mode among the three display modes, onlythe group of icons 2100 are displayed in the function selection menu sothat preview area 3000 is maximized, whereby larger amount of previewinformation can be displayed on preview area 3000.

—Operation to Enter Express Mode

In copy mode initial screen image shown in FIG. 7 (in which functionselecting area 2000 is displayed in the regular mode), or in copy modeinitial screen image shown in FIG. 11 (in which function selecting area2000 is displayed in the icon mode), if express mode entering button2022 is touched, tapped or double-tapped, the initial screen image offunction selecting area 2000 that has been displayed in the regular modeor icon mode on touch-panel display 130 makes a transition to theinitial screen image displayed in the express mode. An exemplary displayon touch-panel display 130 at this time is as shown in FIG. 12. Details(divided into icon portion, text portion and function setting portion)are as shown in FIG. 13.

As shown in FIGS. 12 and 13, the display mode of function selecting area2000 is changed to the express mode. The function selection menuconsists of group of icons 2100, group of texts 2120 and group offunction setting buttons 2140. Specifically, function selecting area2000 includes group of change buttons 2010, and group of icons 2100,group of texts 2120 and group of function setting buttons 2140 of thefunction selection menu. On the right side of display of group offunction setting buttons 2140, a part of an image of expected documentoutput (finished form) 3120 is displayed as preview area 3000. The sizeof function selecting area 2000 (more specifically, the width in thelongitudinal direction of touch-panel display 130) is made wider and thesize of preview area 3000 (more specifically, the width in thelongitudinal direction of touch-panel display 130) is made narrower, andonly a part of image 3120 is shown. As will be described later, whenpreview area 3000 on which only a part of image 3120 is displayed ispressed, preview area 3000 comes to be displayed in front, or comes tobe displayed in an enlarged size.

As described above, in the express mode among the three display modes,group of function setting buttons 2140 are displayed in the functionsetting menu with preview area 3000 made the narrowest, so that it ispossible to set a large number of functions at one time. The user,selecting the express mode, basically sets a plurality of functions atone time without looking at the preview each time, that is, withoutconfirming the result of setting each function one by one.

Referring to FIG. 13, group of function setting buttons 2140 other thanthe group of icons 2100 and group of texts 2120 described above, of thefunction selection menu will be described. As shown in FIG. 13, in thefunction selection menu displayed in the express mode, group of functionsetting buttons 2140 for setting functions corresponding to group oficons 2100 and group of texts 2120 are displayed, enlarged to the sideof preview area 3000.

As the function selection menu displayed on function selecting area2000, corresponding to icon 2102 and text 2122, a setting button 2142for setting the number of copies is displayed. Corresponding to icon2104 and text 2124, a setting button 2144 for setting color mode isdisplayed. Corresponding to icon 2106 and text 2126, a setting button2146 for setting copy density is displayed. Corresponding to icon 2108and text 2128, a setting button 2148 for setting copy magnification isdisplayed. Corresponding to icon 2110 and text 2130, a setting button2150 for setting document type is displayed. Corresponding to icon 2112and text 2132, a setting button 2152 for setting paper type isdisplayed. Corresponding to icon 2114 and text 2134, a setting button2154 for image edition is displayed. Corresponding to icon 2116 and text2136, a setting button 2156 for layout edition is displayed. In FIG. 13and following figures, a button in the selected state will be indicatedby a double frame.

By the group of function setting buttons 2140, it is possible to set aplurality of functions (in FIG. 13, eight functions) at one time.

—Operation of Changing Display Mode by Gesture Operation

As described above, the display mode of function selecting area 2000includes three modes (icon mode, regular mode and express mode) in whichthe size of function selecting area 2000 and the size of preview area3000 (width in the longitudinal direction of touch-panel display 130)are changed. Referring to FIG. 14, transitions among these three modeswill be described. It is noted that at least two modes should beprovided as the display modes.

As described above, while display is given in the regular mode orexpress mode, if icon mode entering button 2012 is touched, tapped ordouble-tapped, transition to the icon mode occurs. While display isgiven in the icon mode or express mode, if regular mode entering button2020 is touched, tapped or double-tapped, transition to the regular modeoccurs. While the display is given in the icon mode or regular mode, ifexpress mode entering button 2022 is touched, tapped or double-tapped,transition to the express mode occurs. In this manner, by operating anentering icon (icon mode entering button 2012, regular mode enteringbutton 2020 and express mode entering button 2022), the display mode offunction selecting area 2000 is switched. In addition, the display modeof function selecting area 2000 can be switched by the gesture operationshown in FIG. 14.

As shown in FIG. 14, if function selecting area 2000 displayed in theregular mode is flicked to the left (if a portion near group of texts2120 of FIG. 7 is flicked to the side of group of icons 2100),transition to the icon mode occurs. If function selecting area 2000displayed in the express mode is flicked widely to the left (if aportion near group of function setting buttons 2140 in FIG. 12 is widelyflicked up around group of icons 2100), transition to the icon modeoccurs.

If function selecting area 2000 displayed in the icon mode is flicked tothe right (if a portion near group of icons 2100 in FIG. 11 is flickedto the side of preview area 3000), transition to the regular modeoccurs. If function selecting area 2000 displayed in the express mode isflicked to the left (if a portion near group of function setting buttons2140 in FIG. 12 is flicked up around group of texts 2120), transition tothe regular mode occurs.

Further, if function selecting area 2000 displayed in the regular modeis flicked to the right (if a portion around group of texts 2120 in FIG.7 is flicked to the side of preview area 3000), transition to theexpress mode occurs. If function selecting area 2000 displayed in theicon mode is flicked widely to the right (if a portion near group oficons 2100 in FIG. 11 is widely flicked to the side of preview area3000), transition to the express mode occurs.

In this manner, not only by a touch operation but also by a gestureoperation, the display mode can be switched. Here, “flick to the left”refers to an operation of the user lightly moving or sweeping his/herfinger that is pressing a central portion of touch-panel display 130 tothe side of function selecting area 2000, and “flick to the right”refers to an operation of the user lightly moving or sweeping his/herfinger that is pressing the central portion of touch-panel display 130to the side of action panel area 4000 (or to the side of task triggerarea 5000). If the arrangement of these areas is reversed, flickdirection is also reversed.

—Request Inputting Operation (Function Setting Operation)

In the express mode, a function is set using any of setting buttons 2142to 2156 for setting desired functions, among the group of functionsetting buttons 2140. By way of example, if the copy magnification is tobe set, setting button 2148 of group of function setting buttons 2140 isused for setting the copy magnification. In the following, the functionsetting operation other than in the express mode will be described. Bythe operation, it is determined at S10110 of the flowchart shown in FIG.5 that a request for setting copy magnification is input.

FIG. 15 shows a screen image for setting copy magnification in theregular mode, which corresponds to FIG. 7. FIG. 16 shows a screen imagefor setting copy magnification in the icon mode, which corresponds toFIG. 11.

In the regular mode, if icon 2108 or text 2128 is pressed, settingbutton 2148 for setting copy magnification is popped-up and displayed asshown in FIG. 15. In the icon mode, if icon 2108 is pressed, settingbutton 2148 for setting copy magnification is popped-up and displayed asshown in FIG. 16. By double-tapping a button of desired magnification ofpopped-up setting button 2148, or by tapping the button of desiredmagnification and thereafter pressing a separately provided “OK” button,the popped-up screen image disappears and the previous display isresumed. In FIGS. 15 and 16, it is assumed that setting button 2148 inthe express mode is popped-up and displayed. It is not limiting,however, and any screen image that allows setting of copy magnificationmay be popped-up and displayed.

In the express mode, if all desired functions are set and the separatelyprovided “OK” button is pressed, transition from the express mode to theicon mode or regular mode occurs, and a preview can be displayed inpreview area 3000 in a large size. It is also possible to make atransition from the express mode to the icon mode or regular mode tohave the preview displayed in preview area 3000 in a large size bypressing part of preview area 3000 that is shown in the express mode.

—Request Inputting Operation (Operation of Changing Manner of PreviewDisplay)

In the following, an operation of changing the manner of display inpreview area 3000 of enlarged size with the display mode of functionselecting area 2000 being the icon mode will be described. By thisoperation, it is determined at S10110 of the flowchart shown in FIG. 5that a request for changing the manner of displaying preview is input.

In the preview area 3000 of enlarged size, it is possible to presentlarger amount of information to the user. Particularly, in layoutedition that requires processing of a plurality of pages as objects, itis possible to display a preview containing a plurality of pages onpreview area 3000.

FIGS. 17 and 18 show exemplary screen images of touch-panel display 130in which a preview containing a plurality of pages is displayed onpreview area 3000. A preview image 3112 shown in FIG. 17 shows, in astereoscopic manner, a state in which the collecting function (2-in-1)and the duplex copy function are set. Preview images 3114 shown in FIG.18 show, in a two-dimensional manner, a plurality of pages with a slidebar 3114A.

When function selecting area 2000 is displayed in the icon mode, previewarea 3000 becomes wider, and the preview images can be displayed torealize better visibility to the user as shown in FIGS. 17 and 18.

As shown in FIG. 17, in preview area 3000, a trash box icon 3112A isdisplayed. By dragging any of the pages of preview images 3112 to trashbox icon 3112A, the page can be deleted. By a gesture operation on thepreview image displayed on preview area 3000, layout edition can becarried out. Since a plurality of pages can be displayed on the widenedpreview area 3000, it is possible for the user to easily confirm thedeleted page. In this manner, by displaying function selecting area 2000in the icon mode to make preview area 3000 wider, user visibility andoperability can be improved.

An operation of changing the manner of displaying a preview (FIG. 19)and the operation of changing preview page (FIG. 20) with preview area3000 widened by displaying function selecting area 2000 in the icon modewill be described.

Referring to FIG. 19, when preview images 3116 are displayed and theuser makes a pinch-out (pinch-open) operation on a portion where thecentral page of three previewed pages is displayed, input trajectory(change in the pressed position on the touch-panel) is analyzed. As aresult of the analysis, it is determined that this gesture operation bythe user is a request to display the page in enlargement, so that thecentral page is enlarged and displayed as a larger preview image.

The preview image can be enlarged or reduced also by using zoom bar3020. By way of example, after selecting a page of which manner ofdisplay is to be changed, the user may touch a plus button 3020A of zoombar 3020, or make a gesture operation (drag or flick) of sliding bar3020C to the side of plus button 3020A, to enlarge the preview of theselected page.

In this manner, the preview image can be enlarged or reduced bydetecting a touch operation or a gesture operation.

A trash box icon 3116A shown in FIG. 19 is similar to trash box icon3112A, and by dragging a selected page to trash box icon 3116A, the pagecan be deleted.

By pressing an icon 3116B for displaying one page, a preview thatcontained three pages, for example, can be changed to a display of onepage (with the one page displayed in larger size). By pressing an icon3116C for displaying a plurality of pages, a preview that contained onepage can be changed to a display of, for example, three pages.

When function selecting area 2000 is displayed in the icon mode, previewarea 3000 can be made wider and, therefore, the preview image can bedisplayed to realize improved visibility and operability of the user, asshown in FIG. 19. Particularly, by detecting a touch operation orgesture operation, the manner of displaying the preview image can bechanged intuitively in accordance with the sense of the user.

As shown in FIG. 20, when preview images 3118 are displayed and the userflicks the screen image of the preview display to the right, inputtrajectory is analyzed. As a result of the analysis, it is determinedthat this gesture operation by the user is a request to turn the page,and a preview of another page that has not been displayed, is displayed,in accordance with the flick direction.

The page of which preview image is to be displayed may be moved by atouch operation of a page feed button 3118G, a page fast feed button3118H, a page return button 3118E or page fast return button 3118D.Further, it is also possible to directly input the page number of whichpreview display is desired, by touching a page direct designation button3118F. By this operation, it is possible to move the preview image thatis being displayed and to display a preview image of the designatedpage.

When function selecting area 2000 is displayed in the icon mode, previewarea 3000 can be made wide and, therefore, the preview image can bedisplayed with higher visibility and higher operability of the user, asshown in FIG. 20. Particularly, by detecting a touch operation or agesture operation, it is possible to move the displayed preview imageand to display a preview of the desired page.

A trash box icon 3118A shown in FIG. 20 is similar to trash box icon3112A, and by dragging a selected page to trash box icon 3118A, the pagecan be deleted.

Similar to the one page displaying icon 3116B described above, bypressing an icon 3118B for displaying one page, a preview that containedthree pages, for example, can be changed to a display of one page (withthe one page displayed in larger size). Similar to the icon 3116C fordisplaying a plurality of pages, by pressing an icon 3118C fordisplaying a plurality of pages, a preview that contained one page canbe changed to a display of, for example, three pages.

—Operation of Changing Manner of Preview Display Based on Function Setby the User

As regards the change in the manner of displaying preview area 3000, itis preferred to change in accordance with a function or functions set bythe user. By way of example, if the user selects a layout editionfunction involving a plurality of pages, on preview area 3000, previewimages of a plurality of pages are displayed. In this state, if the userselects an image edition function on a single page, the preview displayis changed such that a preview image of one page is displayed on previewarea 3000. In this manner, as the preview is changed corresponding tothe function set by the user, the user can easily confirm the setfunction. In any case, the display mode of function selecting area 2000is changed from a mode other than the icon mode to the icon mode.

—Full List Display Operation

If a list button 2018 displayed on function selecting area 2000 of theinitial screen image of the selected operational mode is touched, tappedor double-tapped by the user (YES at S10070), it is determined that thefull list display is requested, and a list of functions selectable inthe selected operational mode is displayed on touch-panel display 130(S10080). If the operational mode is the copy mode, the screen image ofFIG. 21 is displayed on touch-panel display 130.

As shown in FIG. 21, a full list 3130 is displayed using functionselecting area 2000 and preview area 3000. Full list 3130 may bedisplayed using not only function selecting area 2000 and preview area3000 but also action panel area 4000 and task trigger area 5000.Preferably, the area or areas to be used is automatically changed basedon the amount of information of the full list to be displayed.

Full list 3130 displays all functions that can be selected in the copymode as the selected operational mode, in the form of a list. Thedisplay constitutes software buttons and when pressed, transition to ascreen image for setting the corresponding function occurs. A functionhaving an inverted triangle sign such as “DUPLEX COPY” has a sub menu(sub items to be set). The sub items to be set are also displayed ontouch-panel display 130 by pressing the software button of “DUPLEXCOPY.”

[Effects]

As described above, in the image forming apparatus in accordance withthe present embodiment, when an operational mode is switched, adifferent initial screen image is displayed on the touch-panel display.Here, on the touch-panel display, in accordance with a basic layoutdivided into a plurality of display areas, pieces of information havingcommon concepts are displayed on respective ones of the divided areas.Among the five areas (system area, function selecting area, previewarea, action panel area and task trigger area) of basic layout, thefunction selecting area has three display modes. The width in thelongitudinal direction of touch-panel display of the function selectingarea can be changed in accordance with the display mode. Therefore, thesize of preview area next to the function selecting area can also bechanged in the same width direction.

By changing the size of function selecting area and the size of previewarea in the longitudinal direction (width direction) of the touch-paneldisplay, the preview information and the function setting informationdesired by the user can accurately be transmitted to the user, when theexpected result of processing is displayed as a preview beforeprocessing. If the amount of information to be given as preview displayis large, the size of function setting area is made narrower in thewidth direction of the touch-panel display (the size of preview area ismade wider), to enable display of large amount of preview information.If a large amount of function setting information is to be displayed toset a plurality of functions at one time, the size of function settingarea is made wider in the width direction of the touch-panel display(the size of preview area is made narrower), to enable display of largeamount of function setting information.

The embodiments as have been described here are mere examples and shouldnot be interpreted as restrictive. The scope of the present invention isdetermined by each of the claims with appropriate consideration of thewritten description of the embodiments and embraces modifications withinthe meaning of, and equivalent to, the languages in the claims.

1. (canceled)
 2. A display device used in operating an apparatus as anobject of control, comprising: a display that displays information; adisplay controller that controls said display such that said displaydisplays a first image displaying first information and a second imagedisplaying second information; and a touch panel provided on saiddisplay, detecting either a touch operation based on a position where afingertip of a user touched said touch panel or a gesture operationbased on a trajectory of positions where the fingertip of the usertouched said touch panel; wherein said first information includessetting information including a button used to perform a function; saidsecond information includes information of image data to be processed insaid apparatus as the object of control; said display controllersuperposes said first image on said second image upon detection ofeither said touch operation or said gesture operation in a state wheresaid second image is displayed and said first image is not displayed;said first image is an image of an operation menu for said apparatus asthe object of control; and in response to said touch panel detectingsaid touch operation of said first image, information related to saidoperation menu is displayed as a pop-up superposed on said second image.3. The display device according to claim 2, wherein said second imageincludes a third image displaying third information; and said displaycontroller superposes, when superposing said first image on said secondimage, said first image on an area of said second image excluding saidthird image.
 4. A display device according to claim 2, wherein saidsetting information is displayed either in a first manner of display notdisplaying said button, or in a second manner of display displaying saidbutton; said display controller superposes said first image on saidsecond image upon detection of a gesture operation in one direction; andsaid display controller erases said first image upon detection of agesture operation in a direction opposite to said one direction in astate where said first image is superposed on said second image.
 5. Thedisplay device according to claim 4, wherein in said second manner ofdisplay, an icon is further displayed in addition to said button forsetting a function.
 6. The display device according to claim 5, whereinin said second manner of display, function information related to saidfunction is further displayed in addition to said button for setting afunction and the icon.
 7. The display device according to claim 4,wherein in said second manner of display, a plurality of buttonsrespectively corresponding to a plurality of conditions settable forsaid function are displayed.
 8. The display device according to claim 2,wherein the information of image data includes a preview.
 9. The displaydevice according to claim 2, wherein the function includes at least oneof a setting operation, an image file selecting operation, a copyoperation, and an edit operation.
 10. An electronic device provided withthe display device according to claim
 2. 11. An image processingapparatus provided with the display device according to claim
 2. 12. Amethod of displaying information on a display of a display device usedin operating an apparatus as an object of control, said displayincluding a touch panel, said method comprising the steps of: displayinga first image displaying first information including setting informationincluding a button used to perform a function on said display;displaying a second image displaying second information includinginformation of image data to be processed in said apparatus as theobject of control on said display; detecting either a touch operationbased on a position where a fingertip of a user touched said touchpanel, or a gesture operation based on a trajectory of positions wherethe fingertip of the user touched said touch panel; and superposing saidfirst image on said second image upon detection of either said touchoperation or said gesture operation in a state where said second imageis displayed and said first image is not displayed; wherein said firstimage is an image of an operation menu for said apparatus as the objectof control; said method further comprising the step of in response tosaid touch panel detecting said touch operation of said first image,displaying information related to said operation menu as a pop-upsuperposed on said second image.
 13. The method of displayinginformation according to claim 12, wherein said second image includes athird image displaying third information; and at said step ofsuperposing said first image on said second image, said first image issuperposed on an area of said second image excluding said third image.14. The method of displaying information according to claim 12, whereinsaid setting information is displayed either in a first manner ofdisplay not displaying said button, or in a second manner of displaydisplaying said button; said first image is superposed on said secondimage by a gesture operation in one direction; and said method furthercomprising a step of erasing said first image upon detection of agesture operation in a direction opposite to said one direction in astate where said first image is superposed on said second image.
 15. Themethod of displaying information according to claim 14, wherein in saidsecond manner of display, an icon is further displayed in addition tosaid button for setting a function.
 16. The method of displayinginformation according to claim 15, wherein in said second manner ofdisplay, function information related to said function is furtherdisplayed in addition to said button for setting a function and theicon.
 17. The method of displaying information according to claim 14,wherein in said second manner of display, a plurality of buttonsrespectively corresponding to a plurality of conditions settable forsaid function are displayed.
 18. The method of displaying informationaccording to claim 12, wherein the information of image data includes apreview.
 19. The method of displaying information according to claim 12,wherein the function includes at least one of a setting operation, animage file selecting operation, a copy operation, and an edit operation.